Diffusion and Innovation Theory: Past, Present, and Future Contributions to Academia and Practice

Part 4: PanelInternational audienceThe field of information systems (IS) has throughout its history experienced extensive changes in technology, research, and education. These renewals will continue into the foreseeable future [10]. It is recognized that IS is a key force in the ongoing societal and organizational renewal and change [2, 8, 14]. For example, in the US business sector, IS continues yearly to consume about 30% of total investments made [5]. Recent research document that IS supports the creation of business value, with particular emphasis on an organization’s innovation and change capabilities [1, 3]. Traditionally, research in IS has been interdisciplinary in nature - since it draws on innovation theory, models of value creation, actors’ roles and behaviors, the creation and running of task oriented groups, and how these relate to organizational structures and mechanisms [24]. Throughout its history the question of benefits from investing in IS has been lively discussed

Competitive Benchmarking: An IS Research Approach to Address Wicked Problems with Big Data and Analytics

Wicked problems like sustainable energy and financial market stability are societal challenges that arise from complex socio-technical systems in which numerous social, economic, political, and technical factors interact. Understanding and mitigating them requires research methods that scale beyond the traditional areas of inquiry of Information Systems (IS) “individuals, organizations, and markets” and that deliver solutions in addition to insights. We describe an approach to address these challenges through Competitive Benchmarking (CB), a novel research method that helps interdisciplinary research communities to tackle complex challenges of societal scale by using different types of data from a variety of sources such as usage data from customers, production patterns from producers, public policy and regulatory constraints, etc. for a given instantiation. Further, the CB platform generates data that can be used to improve operational strategies and judge the effectiveness of regulatory regimes and policies. We describe our experience applying CB to the sustainable energy challenge in the Power Trading Agent Competition (Power TAC) in which more than a dozen research groups from around the world jointly devise, benchmark, and improve IS-based solutions

Evaluation Beyond Usability

The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCI research. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research